Automatic pattern recognition system



Sept. 20, 1966 s. MOSKOWITZ AUTOMATIC PATTERN RECOGNITION SYSTEM 5 Sheets$heet 1 Filed May 4, 1962 A X z 2) A INVENTOR. (0 2 E By 5404 M05 Ma w/ 72 s. MOSKOWITZ 3,274,549

Sept. 20, 1966 AUTOMATIC PATTERN RECOGNITION SYSTEM 5 Sheets$heet 2 Filed May 4, 1962 Sept. 20, 1966 s. MOSKOWITZ AUTOMATIC PATTERN RECOGNITION SYSTEM 5 Sheets$heet 5 Filed May 4, 1962 Sept. 20, 196

Filed May 4, 19

S. MOSKOWITZ AUTOMATIC PATTERN RECOGNITION SYSTEM bzz 5 Sheets-Sheet 4 MULZ' Mill 7."

OPT/6.4 L

A/V/IL 0a PHOTO 54 5/6 SEA 50E COMFUTA T/OIV 11/5 r WO QK INVENTOR. 5204 /%0.s e0w/rz United States Patent Office Patented Sept. 20, 1966 My invention relates to a novel automatic pattern recognition system, and more specifically relates to a pattern recognition system using a function-ensemble-average concept which is at least partially mechanized through the use of an optical integration system of the type shown in my copending application Serial No. 192,526 filed May 4, 1962, entitled Optical-Analog Integrator, and assigned to the assignee of the present invention.

Automatic pattern recognition systems are well known to the art, and are normally based on correlation techniques. Thus, a stored image is matched to an observed image in an attempt to recognize the observed image. Such matches are very sensitive to metric distortion, noise, overall intensity fluctuation, and, in the case of terrain recognition, to normal image variations and season-a1 and weather variations. Thus, it is always possible with such a system to never achieve a match, even though the proper observed image is observed.

The principle of the present invention utilizes the concept of function-ensemble-average techniques wherein optical-analog integration systems are used in mechanizing the system. The function-ensemble-average concept utilizes averages of various functions over a given intensity distribution (such as a map) to uniquely represent the distribution.

An optical-analog integrating system of the type set forth in my copending application Serial No. 192,526 is then utilized to compute the various averages. This basic system may then be incorporated in a pattern recognition computer which can be used for many different purposes.

By way of example, the system can be used to compute generalized coordinate displacement information; to identify various patterns in a qualitative manner; or serve as the error sensor for a positional or guidance servo loop.

Accordingly, a primary object of this invention is to provide a novel pattern recognition system which eliminates the need for complex digital or analog computers.

Another object of this invention is to provide a novel automatic pattern recognition system which utilizes real time mechanization.

A further object of this invention is to provide a novel pattern recognition system which utilizes no moving parts in the integration circuit, and is capable of high operational reliability.

A further object of this invention is to provide a novel pattern recognition system in which the unique properties 21f a given pattern are implicitly contained in an optical ter.

These and other objects of my novel invention will be apparent from the following description when taken in connection with the drawings, in which:

FIGURE 1 shows an exploded perspective schematic diagram of an optical integration system.

FIGURE 2 schematically represents the manner in which the system of FIGURE 1 can be used to determine coordinate displacement information.

FIGURE 3 illustrates the manner in which the system of FIGURE 1 can be used in an error generator system.

FIGURE 4 illustrates a second embodiment of the integrator circuit of FIGURE 1 when used as an error generator computer for solving a particular equation.

FIGURE 5 schematically repersents the computer system of FIGURE 4 for an implicit displacement computer.

FIGURE 6 schematically represents a detailed circuit system for an error transformation computer.

FIGURE 7 shows a block diagram of an implicit error generator or system.

FIGURE 8 schematically represents a logical identification network for pattern identification.

If x x are the set of coordinates of a particular pattern or map, the intensity distribution function I over a bounded area, A, can be written The average intensity over the entire region, designated M is written '=./'A 1, 2) i 2 If g '(x x is a particular function, then the ensemble average of this function over area A can be found by mul- To reduce sensitivity to intensity fluctuations, intensity normalized moments may be used giving Mzfl MI Writing Equation 4' for purposes of mechanization, 1 2)g.7 i 2) 1 2 AX =2. -f

k i fA b 2) l 2 The a and gj(x x are selected and adjusted for a particular configuration. The bracketed expression of Equation 5.

A121 Za is the function which is represented by the optical filter of an optical-analog-integrator, as will be described hereinafter. As described in my copending application Serial No. 192,526, Equation 6 must be rewritten as;

By inserting Equation 7 into Equation 5,

f w'ilohmdwldxi Kmwn A typical example of the manner in which the constant C is chosen is as follows:

The constant D is defined by the equation Where the only restriction on gj(x x is that it remains finite throughout the acceptable region of x x The quantity 1/ k(x x can only have values between and 1 if it is to be represented by an optical filter. To indicate how the constants C and D; are chosen, the following numerical example is presented:

Let g '(x x )=x x with the area of interest defined by Thus gj(x x can take on values between 4 and +4.

Now

1 lumni can only be zero or positive for all x x Arbitrarily select its minimum value to be zero. Then Equation 4 for the minimum value of g '(x x becomes 4=0+D Thus; D =4 (Note that if it had been arbitrairly decided that was to have been +2, an engineering decision rather than a theoretical requirement, then D; would have been 6).

The solution for C and k(x x is as follows: Equation 4 after the selection of D for the function can now be written.

Solving for 1/k(x x If 1/k(x x is not to exceed the value 1 for the maximum value of x x which is +4, then or C 8 Finally defining the function k(x x as,

This procedure can be applied similarly to any function of interest.

Mziu xp They form sets of equations f1( ky 1"z /M) =0 where Using Equation 7 The nature of the optical-analog-integrator requires the normalized moments to be written,

The exact form of the equations (9) is dependent upon the particular intensity distribution considered. The primary advantage of this mechanization with respect to the explicit approach is the possibility of greater accuracy. The physical structure to be used to compute Equation 10 will be shown later.

Where the system is to be used for pattern identification, for a given pattern class the ensemble averages of particular functions are of significant magnitude while for other pattern classes other functions are significant. Let there be a group of functions whose ensemble averages uniquely define a pattern class. If these functions are designated g (x where i is the index over the dimension n of the pattern and j the index over the number K of the significant functions, then a quantity Q can be written Q is thus a measure of I(x being the desired pattern. Depending upon the size of Q an appropriate. factor of confidence can be assigned to the identification. For purposes of mechanization, Equation 11 should be rewritten interchanging the order of integration and summation,

Another approach to pattern identification is the logical sequence approach which can be considered to fall in thev class of implicit mechanization.

Identification is achieved by a series of decisions or choices each dependent on the value obtained for each previous particular function average. Let there be a set of averages,

=fA i)gi( i) i Considered in order, the value of each M (X1) determines the interpretation of each subsequent M thus, a logical network or path is built up, the final form of the path establishing an identification. A typical structure for mechanizing Equation 13 will be given hereinafter.

For purposes of incorporating the novel system in a servo loop, as an error signal generator, one wants the error signal to approach zero monotonically as the viewing window approaches the desired target. Rather than express displacement as a function of the observed function averages, an expression in terms of function average differences is required. By a choice of appropriate constants, the readout signal (now used as an error signal) can be made to approach zero as the displacement approaches zero.

In this embodiment, a particular generalized coordinate displacement error signal Ex can be written as a linear combination of the differences between particular normalized moments; observed and reference. Let the subscript (o) designate the moment for the desired area of match. Then,

M M (14) Interchanging the order of summation and integration,

fA, 1, a r z A CM,

Notice the similarity of Equation 16 to Equation 8. The main difference, which is quite significant is that Equation 14, rather than Equation 16 itself, is used to evaluate the constants for a particular matching region. The appearance of the mechanization is identical in Equation 16 and Equation 8. However, the principle of operation is quite different.

Again, as with problems of the type involved in deriving Equation 9, a set of M equations in the variables Ex and the intensity normalized moment differences where 1:1, 2, M can be used for purposes of obtaining an implicit rather than an explicit mechanization. The nature of the optical-analog-integrator requires that the normalized moment differences be written Mai (x1, :1) M xi (x1. x2) T-W a 0 1, 2) fau n 'zm i z fA i 1, 2) 1 2 i Notice the similarity between Equation 18 and Equation 10. The difference lies in the method used to pre-evaluate the constants which appear in the equation of mechanization, Equation 17. The exact form of Equations 17 is dependent upon the particular intensity distribution considered.

FIGURES 1 and 2 illustrate the manner in which Equation 8 can be solved where the device is used to generate displacement coordinate information. An image derived in any desired manner is displayed on two cathode ray tubes 10 and 11, or their equivalent, with an optical filter 12 rep-resenting the function 1/k(x x in front of the first tube 10. It is to be noted that it is also possible to use only one image display means, and insert the filter 12 and perform the calculations sequentially. Thus, the intensity distribution I (x x of the primary image source 10 is multiplied by the functional filter to yield the product I (x x )/k(x x A condensing lens system 13 focuses this spacial intensity distribution upon the photosensor cell 14 which, because it measures the total energy incident upon itself, effectively integrates the particular spacial intensity distribution. The same intensity distribution l (x x displayed by the secondary image source 11 is focused, unfiltered, upon the photosensor cell 15 by another condensing 'lens system 16' (or sequentially by the same condensing lens system 13 on the photosensor cell 14).

The outputs of the photosensor cells 14 and 15 are connected to the computation network 16 detailed in FIGURE 2. Referring to FIGURE 2, the output of photosensor cell 14, which corresponds to the unnormalized function-ensemble average, is multiplied by the preset constant C in multiplier 17 connected to function generator 18 which generates C The output of multiplier 17 is then divided by the output of the photosensor cell 15, which is the normalization integral in divider 19. To this quantity is added the preset constant D to yield the desired output Ax by connecting the output of divider 19 to adder 20 which receives constant D from generator 21.

The front end of the explicit error generator computer is also shown in FIGURE 1. However, the computation network required to instrument Equation 16 is shown in FIGURE 3. Referring to FIGURE 3, the output is not Ax but rather Ex which is a servo error signal. This signal may be used to energize a control motor or engine 30 which can drive a vehicle or vehicle platform 31 upon which the sensor front end 3 2 is mounted, so as to achieve a null. The significant difference between the instrumentations shown in FIGURE-S 2 and 3 is the method of precomputation, the meaning of the constants 6 C D and E and a subtractor 33 in place of adder 20 of FIGURE 2.

FIGURE 4 shows a mechanical schematic representation of either the implicit displacement computer or the implicit error generator computer as would be used for a particular problem. In FIGURE 4, there are three image sources 40, 41 and 42 which cooperate with condensing optical system-s 43, 44 and 45 respectively, and integrating photosensor cells 46, 47 and 4 8 respectively. The out-puts of cells 46, 47 and 48 are appropriately combined in computer network 49, as will be described.

The outputs of sources 40 and 41 are altered by filters 50 and 57 respectively which represent the functions and iwi, 2) 26 1, 2)

respectively. For the problem chosen for illustrative purposes Equations 9 are reduced to two equations in The constants a a a a and the functions are appropriately chosen and evaluated for the given problem. Mechanizations of equations more complicated than Equations 19 and 20 but in the same form are also covered by this invention.

A schematic representation of the computation network -for the implicit displacement computer of FIGURE 4 is shown in FIGURE 5. The outputs of the photosensor cells 46 and 48 (the function-ensembleaverages of and 1/K (x x are divided in dividers 60 and 61, respectively, by the output of photosensor cell 47 which is the normalization integral. These quantities are multiplied by the appropriate preset constants a a a and a in multipliers 62, 63, 64 and 65 to yield the quantities b h h and b The implicity (closed loop) determined outputs Ax, and Ax are used to multiply the proper b in multipliers 66, 67, 68 and 69, and these quantities summed with the constant 1 in subtractors 70 and 71 to yield computer servo l-oop error signals e and e These error signals are transformed in error transformation system 72 by means of the transported b matrix into errors in the variables, e(Ax and e(Ax These values are used to increment Ax, and Ax Theoretically, the inverse b matrix should be used. However, for all practical purposes the above approach is satisfactory. Details of the mechanization of the error transformation are shown in FIGURE 6 as shown including multipliers 73, 74, 75 and 76 and adders 77 and 78.

The computation network of the implicit error generator appears identical in form to that of the implicit displacement computer. Again it is the method used to evaluate the constants for a given problem and the use of the output signals that are appreciably different. The block diagram of FIGURE 7 illustrates this. The output error signal Ex and Ex are used as control signals for vehicle motors or engines 80 and 82 respectively of ve- When the system is mechanized for pattern identification, a quantitative signal is not required. Rather, various patterns, independent of their relative orientation or position, must be distinguished, one from the other. Mechanization of Equation 12 is easily accomplished by means of a single filter placed in front of the image source, as in FIGURE 1 but without a secondary image source. The output of photosensor 14 is used as a direct measure of the identification. Such a system is only useful for identifying one particular pattern. For different patterns dilferent filters 12 are required.

It is possible by means of a logical network or networks to be able to identify different patterns or classes of patterns with a single mechanization. FIGURE 8 is a schematic representation of such a logical network which is shown for purposes of illustration as a means for distinguishing between eight different classes of patterns based upon information obtained from three optical integrator systems. If a third filter is placed in front of the C image source of FIGURE 4, then FIGURE 4 is an appropriate mechanical schematic representation of this computer. The logical identification network of FIG- URE 8 replaces the computation network of FIGURE 4. The magnitude of the signal from each photosensor cell 46, 47 and 48 is used to actuate the various signal switches 92, 93 and 94 respectively through energizing circuits 95, 96 and 97 respectively. Two position switches for switches 92, 93 and 94 are shown, although it is possible to have three or more position switches actuated by various levels of each photosensor cell signal. With the scheme presented, many fewer optical-analog integrator systems are required than the number of different pattern classes to be identified where a particular pattern is selected by appropriate circuit means connected from terminal to terminals labeled Class 1 thnough Class 8.

Although I have described preferred embodiments of my novel invention, many variations and modifications will now be obvious to those skilled in the art, and I prefer to be limited, therefore, not by the specific disclosure herein, but only by the appended claims.

I claim:

1. A pattern recognition system; said pattern recognition system comprising first and second and third image producing means for producing an image of a common object to be identified, first, second and third transducer means for receiving the radiant energy across the full area of said first, second and third images respectively, filter means for partially absorbing a predetermined portion of the energy of said first and second image interposed between said first and second image and said first and second transducer means, and computation network means for computing pattern information from the outputs of said first, second and third transducers; the output of said first cell being related to fAKz 1, 2)

wherein K (x x is a second function of variables x x over the area A the output of said third cell being related to said computer being operable to compute the implicit displacement information Ax and Ax of said pattern from a predetermined value.

2. A pattern recognition system; said pattern recognition system comprising first and second and third image producing means for producing animage of a common object to be identified, first, second and third transducer means for receiving the radiant energy across the full area of said first, second and third images respectively, filter means for partially absorbing a predetermined portion of the energy of said first and second image interposed between said first and second image and said first and second transducer means, and computation network means for computing pattern information from the outputs of said first, second and third transducers; the output of said first cell being related to 1( 1 2) wherein I (x x is a variable intensity distribution over the area A and K (x x is a function of variables x and x over the area A the output of said second cell being related to f I 11 2) AKz 1, 2) wherein K (x x isa second function of variables x x over the area A the output of said third cell being related to dm dat tion of the energy of said first and second image inter posed between said first and second image and said first and second transducer means, and computation network means for computing pattern information from the outputs of said first, second and third transducers; the output of said first cell being related to f I031: 2) AKI 1: 2) wherein l(x x is a variable intensity distribution over the area A and K (x x is a function of variables x and x over the area A the output of said second cell being related to dx 1 dig J ICED 2) AK2( 1, 2) wherein K (x x is a second function of variables x x over the area A the output of said third cell being related to dill 1 (11172 fA 1, 2) i 2 said outputs of said first, second and third cells being connected to respective switching circuits, respectively, operable at a selected signal level; said first switching circuit including a first movable contact; said second switching circuit including second and third movable contact means; only one of said second and third movable contacts being connectable in series with said first movable contact at one time; said third switching circuit including a plurality of movable contacts selectively connectable in series with said second and third contacts whereby, depending upon the output of said first, second, and third cells, only one of said plurality of movable contacts is connected to said first movable contact through one of said second or third contacts; eachof said plurality of movable contacts being connected to a respective pattern class identifying circuit.

(References on following page) 9 10 References Cited by the Examiner 3,089,917 5/ 1963 Fe-rnicola 1786.5 3 111 666 11/1963 Wilmotte 2J35*181 X ATENT UNITED STTES P S 3,144,554 8/1964 Whitney 250-833 10/1958 Sellger 340-190 X 12/ 1960 Hobrough.

10/1961 Leighton et a1. 5 MALCOLM A. MORRISON, Przmary Exammer. 11/1962 Shel-ton.

I. KESCHNER, K. DOBYNS, Assistant Examiners. 

1. A PATTERN RECOGNITION SYSTEM; SAID PATTERN RECOGNITION SYSTEM COMPRISING FIRST AND SECOND AND THIRD IMAGE PRODUCING MEANS FOR PRODUCING AN IMAGE OF A COMMON OBJECT TO BE INDENTIFIED, FIRST, SECOND AND THIRD TRANSDUCER MEANS FOR RECEIVING THE RADIANT ENERGY ACROSS THE FULL AREA OF SAID FIRST, SECOND AND THIRD IMAGES RESPECTIVELY, FILTER MEANS FOR PARTIALLY ABSORBING A PREDETERMINED PORTION OF THE ENERGY OF SAID FIRST AND SECOND IMAGE INTERPOSED BETWEEN SAID FIRST AND SECOND IMAGE AND SAID FIRST AND SECOND TRANSDUCER MEANS, AND COMPUTATION NETWORK MEANS FOR COMPUTING PATTERN INFORMATION FROM THE OUTPUTS OF SAID FIRST, SECOND AND THIRD TRANSDUCERS; THE OUTPUT OF SAID FIRST CELL BEING RELATED TO 